Example Profiling Report

Dataset statistics

Number of variables	9
Number of observations	2018352
Missing cells	528
Missing cells (%)	< 0.1%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	138.6 MiB
Average record size in memory	72.0 B

Variable types

Numeric	8
Text	1

Alerts

`row_id` is uniformly distributed	Uniform
`row_id` has unique values	Unique
`county` has 212928 (10.5%) zeros	Zeros
`is_business` has 934848 (46.3%) zeros	Zeros
`product_type` has 170544 (8.4%) zeros	Zeros
`target` has 351496 (17.4%) zeros	Zeros
`is_consumption` has 1009176 (50.0%) zeros	Zeros
`prediction_unit_id` has 30624 (1.5%) zeros	Zeros

Reproduction

Analysis started	2023-12-17 17:56:33.952673
Analysis finished	2023-12-17 17:57:17.026318
Duration	43.07 seconds
Software version	ydata-profiling vv4.6.3
Download configuration	config.json

county
Real number (ℝ)

ZEROS

Distinct	16
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	7.2970344

Minimum	0
Maximum	15
Zeros	212928
Zeros (%)	10.5%
Negative	0
Negative (%)	0.0%
Memory size	15.4 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	3
median	7
Q3	11
95-th percentile	15
Maximum	15
Range	15
Interquartile range (IQR)	8

Descriptive statistics

Standard deviation	4.7809903
Coefficient of variation (CV)	0.65519635
Kurtosis	-1.2281563
Mean	7.2970344
Median Absolute Deviation (MAD)	4
Skewness	0.023421192
Sum	14727984
Variance	22.857869
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=16)

Value	Count	Frequency (%)
0	212928	10.5%
11	198000	9.8%
7	173088	8.6%
5	151632	7.5%
15	148752	7.4%
4	147264	7.3%
10	134640	6.7%
14	125808	6.2%
3	122496	6.1%
9	122496	6.1%
Other values (6)	481248	23.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	212928	10.5%
1	91872	4.6%
2	115200	5.7%
3	122496	6.1%
4	147264	7.3%
5	151632	7.5%
6	30624	1.5%
7	173088	8.6%
8	91872	4.6%
9	122496	6.1%

Value	Count	Frequency (%)
15	148752	7.4%
14	125808	6.2%
13	121056	6.0%
12	30624	1.5%
11	198000	9.8%
10	134640	6.7%
9	122496	6.1%
8	91872	4.6%
7	173088	8.6%
6	30624	1.5%

is_business
Real number (ℝ)

ZEROS

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.53682608

Minimum	0
Maximum	1
Zeros	934848
Zeros (%)	46.3%
Negative	0
Negative (%)	0.0%
Memory size	15.4 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	1
Q3	1
95-th percentile	1
Maximum	1
Range	1
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.49864212
Coefficient of variation (CV)	0.92887088
Kurtosis	-1.978185
Mean	0.53682608
Median Absolute Deviation (MAD)	0
Skewness	-0.14770561
Sum	1083504
Variance	0.24864396
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=2)

Value	Count	Frequency (%)
1	1083504	53.7%
0	934848	46.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	934848	46.3%
1	1083504	53.7%

Value	Count	Frequency (%)
1	1083504	53.7%
0	934848	46.3%

product_type
Real number (ℝ)

ZEROS

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1.8989274

Minimum	0
Maximum	3
Zeros	170544
Zeros (%)	8.4%
Negative	0
Negative (%)	0.0%
Memory size	15.4 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	2
Q3	3
95-th percentile	3
Maximum	3
Range	3
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.0817658
Coefficient of variation (CV)	0.56967201
Kurtosis	-1.5244696
Mean	1.8989274
Median Absolute Deviation (MAD)	1
Skewness	-0.19921777
Sum	3832704
Variance	1.1702173
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=4)

Value	Count	Frequency (%)
3	918720	45.5%
1	781632	38.7%
0	170544	8.4%
2	147456	7.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	170544	8.4%
1	781632	38.7%
2	147456	7.3%
3	918720	45.5%

Value	Count	Frequency (%)
3	918720	45.5%
2	147456	7.3%
1	781632	38.7%
0	170544	8.4%

target
Real number (ℝ)

ZEROS

Distinct	565566
Distinct (%)	28.0%
Missing	528
Missing (%)	< 0.1%
Infinite	0
Infinite (%)	0.0%
Mean	274.85556

Minimum	0
Maximum	15480.274
Zeros	351496
Zeros (%)	17.4%
Negative	0
Negative (%)	0.0%
Memory size	15.4 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0.378
median	31.133
Q3	180.20625
95-th percentile	1080.6113
Maximum	15480.274
Range	15480.274
Interquartile range (IQR)	179.82825

Descriptive statistics

Standard deviation	909.50238
Coefficient of variation (CV)	3.3090194
Kurtosis	73.303419
Mean	274.85556
Median Absolute Deviation (MAD)	31.133
Skewness	7.6760621
Sum	5.5461015 × 10⁸
Variance	827194.58
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	351496	17.4%
0.001	10733	0.5%
0.003	6619	0.3%
0.002	5365	0.3%
0.004	4593	0.2%
0.005	2792	0.1%
0.1	2316	0.1%
0.006	2180	0.1%
0.007	1889	0.1%
0.015	1861	0.1%
Other values (565556)	1627980	80.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	351496	17.4%
0.001	10733	0.5%
0.002	5365	0.3%
0.003	6619	0.3%
0.004	4593	0.2%
0.005	2792	0.1%
0.006	2180	0.1%
0.007	1889	0.1%
0.008	1721	0.1%
0.009	1403	0.1%

Value	Count	Frequency (%)
15480.274	1	< 0.1%
15438.643	1	< 0.1%
15353.106	1	< 0.1%
15332.71	1	< 0.1%
15324.393	1	< 0.1%
15324.196	1	< 0.1%
15323.602	1	< 0.1%
15304.209	1	< 0.1%
15299.353	1	< 0.1%
15271.603	1	< 0.1%

is_consumption
Real number (ℝ)

ZEROS

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.5

Minimum	0
Maximum	1
Zeros	1009176
Zeros (%)	50.0%
Negative	0
Negative (%)	0.0%
Memory size	15.4 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0.5
Q3	1
95-th percentile	1
Maximum	1
Range	1
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.50000012
Coefficient of variation (CV)	1.0000002
Kurtosis	-2.000002
Mean	0.5
Median Absolute Deviation (MAD)	0.5
Skewness	0
Sum	1009176
Variance	0.25000012
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=2)

Value	Count	Frequency (%)
0	1009176	50.0%
1	1009176	50.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1009176	50.0%
1	1009176	50.0%

Value	Count	Frequency (%)
1	1009176	50.0%
0	1009176	50.0%

datetime
Text

Distinct	15312
Distinct (%)	0.8%
Missing	0
Missing (%)	0.0%
Memory size	15.4 MiB

Length

Max length	19
Median length	19
Mean length	19
Min length	19

Characters and Unicode

Total characters	38348688
Distinct characters	13
Distinct categories	4 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	2021-09-01 00:00:00
2nd row	2021-09-01 00:00:00
3rd row	2021-09-01 00:00:00
4th row	2021-09-01 00:00:00
5th row	2021-09-01 00:00:00

Value	Count	Frequency (%)
05:00:00	84098	2.1%
22:00:00	84098	2.1%
13:00:00	84098	2.1%
11:00:00	84098	2.1%
10:00:00	84098	2.1%
09:00:00	84098	2.1%
08:00:00	84098	2.1%
07:00:00	84098	2.1%
06:00:00	84098	2.1%
04:00:00	84098	2.1%
Other values (652)	3195724	79.2%

Most occurring characters

Value	Count	Frequency (%)
0	13610858	35.5%
2	7026302	18.3%
-	4036704	10.5%
:	4036704	10.5%
1	3325466	8.7%
	2018352	5.3%
3	1227270	3.2%
5	566980	1.5%
4	559060	1.5%
9	545428	1.4%
Other values (3)	1395564	3.6%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	28256928	73.7%
Dash Punctuation	4036704	10.5%
Other Punctuation	4036704	10.5%
Space Separator	2018352	5.3%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	13610858	48.2%
2	7026302	24.9%
1	3325466	11.8%
3	1227270	4.3%
5	566980	2.0%
4	559060	2.0%
9	545428	1.9%
7	465844	1.6%
8	465700	1.6%
6	464020	1.6%

Dash Punctuation

Value	Count	Frequency (%)
-	4036704	100.0%

Other Punctuation

Value	Count	Frequency (%)
:	4036704	100.0%

Space Separator

Value	Count	Frequency (%)
	2018352	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	38348688	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	13610858	35.5%
2	7026302	18.3%
-	4036704	10.5%
:	4036704	10.5%
1	3325466	8.7%
	2018352	5.3%
3	1227270	3.2%
5	566980	1.5%
4	559060	1.5%
9	545428	1.4%
Other values (3)	1395564	3.6%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	38348688	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	13610858	35.5%
2	7026302	18.3%
-	4036704	10.5%
:	4036704	10.5%
1	3325466	8.7%
	2018352	5.3%
3	1227270	3.2%
5	566980	1.5%
4	559060	1.5%
9	545428	1.4%
Other values (3)	1395564	3.6%

data_block_id
Real number (ℝ)

Distinct	638
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	321.8746

Minimum	0
Maximum	637
Zeros	2928
Zeros (%)	0.1%
Negative	0
Negative (%)	0.0%
Memory size	15.4 MiB

Quantile statistics

Minimum	0
5-th percentile	34
Q1	166
median	323
Q3	479
95-th percentile	606
Maximum	637
Range	637
Interquartile range (IQR)	313

Descriptive statistics

Standard deviation	182.63431
Coefficient of variation (CV)	0.56740828
Kurtosis	-1.1823282
Mean	321.8746
Median Absolute Deviation (MAD)	157
Skewness	-0.018882935
Sum	6.4965624 × 10⁸
Variance	33355.293
Monotonicity	Increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
452	3312	0.2%
450	3312	0.2%
436	3312	0.2%
437	3312	0.2%
438	3312	0.2%
439	3312	0.2%
440	3312	0.2%
441	3312	0.2%
442	3312	0.2%
443	3312	0.2%
Other values (628)	1985232	98.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	2928	0.1%
1	2928	0.1%
2	2928	0.1%
3	2928	0.1%
4	2928	0.1%
5	2928	0.1%
6	2928	0.1%
7	2928	0.1%
8	2928	0.1%
9	2928	0.1%

Value	Count	Frequency (%)
637	3120	0.2%
636	3120	0.2%
635	3120	0.2%
634	3120	0.2%
633	3168	0.2%
632	3168	0.2%
631	3168	0.2%
630	3216	0.2%
629	3216	0.2%
628	3216	0.2%

row_id
Real number (ℝ)

UNIFORM UNIQUE

Distinct	2018352
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1009175.5

Minimum	0
Maximum	2018351
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	15.4 MiB

Quantile statistics

Minimum	0
5-th percentile	100917.55
Q1	504587.75
median	1009175.5
Q3	1513763.2
95-th percentile	1917433.4
Maximum	2018351
Range	2018351
Interquartile range (IQR)	1009175.5

Descriptive statistics

Standard deviation	582648.18
Coefficient of variation (CV)	0.5773507
Kurtosis	-1.2
Mean	1009175.5
Median Absolute Deviation (MAD)	504588
Skewness	-3.629882 × 10^-15
Sum	2.0368714 × 10¹²
Variance	3.394789 × 10¹¹
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
1345578	1	< 0.1%
1345576	1	< 0.1%
1345575	1	< 0.1%
1345574	1	< 0.1%
1345573	1	< 0.1%
1345572	1	< 0.1%
1345571	1	< 0.1%
1345570	1	< 0.1%
1345569	1	< 0.1%
Other values (2018342)	2018342	> 99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
2018351	1	< 0.1%
2018350	1	< 0.1%
2018349	1	< 0.1%
2018348	1	< 0.1%
2018347	1	< 0.1%
2018346	1	< 0.1%
2018345	1	< 0.1%
2018344	1	< 0.1%
2018343	1	< 0.1%
2018342	1	< 0.1%

prediction_unit_id
Real number (ℝ)

ZEROS

Distinct	69
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	33.045376

Minimum	0
Maximum	68
Zeros	30624
Zeros (%)	1.5%
Negative	0
Negative (%)	0.0%
Memory size	15.4 MiB

Quantile statistics

Minimum	0
5-th percentile	3
Q1	16
median	33
Q3	50
95-th percentile	64
Maximum	68
Range	68
Interquartile range (IQR)	34

Descriptive statistics

Standard deviation	19.590594
Coefficient of variation (CV)	0.5928392
Kurtosis	-1.211029
Mean	33.045376
Median Absolute Deviation (MAD)	17
Skewness	0.019035511
Sum	66697200
Variance	383.79137
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	30624	1.5%
46	30624	1.5%
32	30624	1.5%
33	30624	1.5%
1	30624	1.5%
35	30624	1.5%
36	30624	1.5%
37	30624	1.5%
38	30624	1.5%
39	30624	1.5%
Other values (59)	1712112	84.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	30624	1.5%
1	30624	1.5%
2	30624	1.5%
3	30624	1.5%
4	30624	1.5%
5	30624	1.5%
6	30624	1.5%
7	30624	1.5%
8	30624	1.5%
9	30624	1.5%

Value	Count	Frequency (%)
68	3312	0.2%
67	23280	1.2%
66	24768	1.2%
65	24768	1.2%
64	26256	1.3%
63	29184	1.4%
62	29184	1.4%
61	29184	1.4%
60	30624	1.5%
59	30624	1.5%

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	is_business	product_type	target	is_consumption	datetime	row_id	prediction_unit_id
0	0	1	0.713	0	2021-09-01 00:00:00	0	0
1	0	1	96.590	1	2021-09-01 00:00:00	1	0
2	0	2	0.000	0	2021-09-01 00:00:00	2	1
3	0	2	17.314	1	2021-09-01 00:00:00	3	1
4	0	3	2.904	0	2021-09-01 00:00:00	4	2
5	0	3	656.859	1	2021-09-01 00:00:00	5	2
6	1	0	0.000	0	2021-09-01 00:00:00	6	3
7	1	0	59.000	1	2021-09-01 00:00:00	7	3
8	1	1	0.000	0	2021-09-01 00:00:00	8	4
9	1	1	501.760	1	2021-09-01 00:00:00	9	4

	county	is_business	product_type	target	is_consumption	datetime	data_block_id	row_id	prediction_unit_id
2018342	15	0	1	0.004	0	2023-05-31 23:00:00	637	2018342	57
2018343	15	0	1	42.401	1	2023-05-31 23:00:00	637	2018343	57
2018344	15	0	3	2.287	0	2023-05-31 23:00:00	637	2018344	58
2018345	15	0	3	117.332	1	2023-05-31 23:00:00	637	2018345	58
2018346	15	1	0	0.000	0	2023-05-31 23:00:00	637	2018346	64
2018347	15	1	0	197.233	1	2023-05-31 23:00:00	637	2018347	64
2018348	15	1	1	0.000	0	2023-05-31 23:00:00	637	2018348	59
2018349	15	1	1	28.404	1	2023-05-31 23:00:00	637	2018349	59
2018350	15	1	3	0.000	0	2023-05-31 23:00:00	637	2018350	60
2018351	15	1	3	196.240	1	2023-05-31 23:00:00	637	2018351	60

Overview

Variables

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Dash Punctuation

Other Punctuation

Space Separator

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Missing values

Sample